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ABSTRACT 


The purpose of this paper is to examine DoD quality assurance 
policies and their application to Weapon System Acquisition Management. 
This paper is divided into six sections -- Elements of Policy, DoD Quality 
Assurance Policy, Quality Assurance During System Procurement, Areas 
Needing Improvement, Project Management, and Conclusions and 
Recommendations. 

In general, quality assurance policies are consistent and well 
defined, but the procedures for implementing these policies needrevision 
in the area of subcontract STRAUS EN LOM Particular problems include 
the lack of standardized procedures for use by the Military Departments 
and DCAS, and the inability of contract administration offices at sub- 
contract facilities to perform surveillance because of insufficient 
personnel. 

The major deficiency in quality assurance procedures involves t 2 
Inspection Clause in ASPR which makes acceptance at the source final. 
The clause is not appropriate for current DoD policy of placing responsi- 


bility for quality on its contractors because government acceptance 


relieves the contractor of this responsibility. 
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ee inom Cron 


The assignment of a Naval officer to an Acquisition billet is a 
challenge to his ability to discern Department of Defense policy with 
respect to his job and, having accomplished that, to perform in accordance 
with directives and regulations from several different sources. The pur- 
pose of this paper is to examine Department of Defense Quality Assurance 
policies and their application to Weapon Systems Aquisition Management. 
The objective is to enable Naval officers to gain appreciation for the 
Department of Defense Quality Assurance policies without reference and 
cross-reference to the Armed Services Procurement Regulations (ASPR), 
Navy and Devartment of Defense Regulations and Directives, Military 
Specifications, and various contract administration agencies' Handbook 
for Quality and Reliability Assurance. 

The material in this paper is presented in six sections. The first 
section discusses elements of policy and the mechanics for effective 
policies. 

Section two discusses current Department of Defense quality 
assurance policies. 

Section three discusses auality assurance during system procure- 
ment. The procurement cycle is a down into two phases. Inthe 
first phase cooperation between technical, quality assurance and contract- 
ing personnel is necessary in order to prepare for contract award. Inthe 


second phase the principal concerns are the methods and problems of 





implementing the quality assurance provisions after the contract is signed -- 
both at the contractor's plant and at the subcontractor's plants. In each 
area, informational material is followed by the identification of apparent 
problems. 

In section four areas are discussed in which quality assurance 
improvements are needed. Informational material is presented, the prob- 
lem identified, and tentative solutions are offered. 

In section five materials are presented which should be useful to 
the Project Manager during the administration of his quality assurance 
responsibilities. 

Section six contains the recommendations and conclusions of this 
paper. 

The material contained in this paper was obtained from several 
sources. Material from Defense Contract Administration Service (DCAS) 
was obtained by a visit to the Quality Assurance Representative (QAR) a 
Teledyne McCormich plant in Hollister, California and by tele; hone inte - 
views with other DCAS personnel. Materials on quality assurance and 
contract administration were obtained by several visits to Lockheed Missile 
Space Company r Sunnyvale, California. Discussions were held both with 
contractor personnel and with personnel from the Naval Plant Representa- 
tive Office (NAVPRO SUNNYVALE). Other materials were obtained from 
phone interviews with personnel in Naval Material Command and in the 


Office of the Assistant Secretary of Defense for Installation and Logistics. 





II. SUMMARY OF CONCLUSIONS AND RECOMMENDATIONS 


A. SMANDARDIZED PROCEDURES 
Although quality assurance policy has been standardized, there is 
a need to standardize contract administration. 


page 18 


B. CROSS TRAINING 

During system procurement it is imperative for technical and con- 
tracting personnel to function as a team. One method of improwing the 
technical/contract personnel interface is through specially designed 


courses for contract and technical personnel. page 2% 


©. TRAINING 

Many DoD studies have recommended nasse the skill level of 
quality assurance personnel and a DoD career training program for techni- 
cal levei personnel has been initiated; however, more professional level 
training is required to ensure uniform implementation of DoD quality 


assurance policies. page 28 


IDA SUBCONTRACT ADMINISTRATION 

Personnel cuts in the Contract Administration Services have reduced 
the Government's ability to perform subcontract quality assurawce functions 
authorized by ASPR. Two methods are proposed as possible solutions. 


page _ 31 





E. ASPR- REGULATORY EFFECT 
When a problem arises or incident occurs in the procurement cycle, 
the reaction is to establish a regulation which will prevent this problem 


mom ever occurring again. page 36 


E. TESHNICAL DATA DEFICIENCIES 

One method of improving technical data collection is through the 
development oí a military specification or standard to prescribe the qual- 
ity controls contractors must maintain to assure accuracy and technical 


adequacy of the technica] data. page 36 


G. SMALL BUSINESS PROGRAM 

The maintenance of an effective Small Business Program requires 
the requiring activity to commit the resources and personnel necessary to 
assist Small Business firms in producing acceptable products for the 


Government. page 40 


H, PUBLIC LAW 92-156 
Public Law 92-156 impacts the development cycle schedule and 
requires new procedures for reporting results of IOT & E to Congress 


prior to the Production decision. page 4] 


I. WARRANTIES AND THE INSPECTION CLAUSE 
The Inspection Clause should be revised to reduce finality of accep- 
tance in order to be consistent with current DoD quality assurance 


policies. page 4] 
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ir PROJECT MANAGERS 

The Project Manager should examine the quality assurance require- 
ments for his program early in the developmental cycle and should include 
Quality Assurance specialists as participants in the early design and 
conceptual phases of his program in order to help define the technical 
requirements including optimization of designs and processes. 


page 45 
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III. ELEMENTS OF POLICY 


A, GENERAL 

Because the purpose of this paper is to examine Department of 
ference Quality Assurance policies, a section devoted to the elements 
of policy is appropriate. Readers familiar with DoD policies and proce- 
dures may wish to proceed to Section V, Quality Assurance During System 


Procurement. 


B. DEFINITION 

A policy is a general statement of the intended behavior of organi- 
Zation. It provides guidance for planning and decision making within the 
E ework of existing resources and regulation. The objective ofa 
policy is to limit the scope within which decisions must be made. Thus 


policies are guides to thinking and decision making. 


oF REOUIREMENTS FOR EFFECTIVE POLICIES 

Policy exists to guide subordinate managers in the implementation 
of their responsibilities. Effective policies are required to prevent confu- 
sion and to ensure that subordinate managers understand ee is expected 
in the way of decisions that contribute toward organizational objectives. 
Thus one way of achieving effective policies is to ensure that policies 
reflect the objectives and plans of the A A new concept or way 


of doing business can render a policy obsolete overnight. 
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A second method for obtaining effective policies is through consis- 
tency and flexible application. Consistency is best achieved through 
consolidation and presentation of related policies together so that the 
intent of the originator is better understood. The need for flexibility in 
the application of policies arises because of the complex nature of Weapon 
System Acquisition. Continued requests for exception indicate either the 
policy was not designed for current conditions or that the subordinate 
manager is too tightly restricted. 

The third method for obtaining effective policies is perhaps the most 
important. A careful distinction should be made between policies, proce- 
dures, and rules. The correct separation is important for good planning, 
and delegation of authority. Policies are guides to thinking and decision 
making. Procedures are plans that establish a required method for hand- 
ling specific activities or events. Rules are plans that require a specific 
action to be taken with respect to a specific situation. 

Effective policies are important in terms of the achievement of 
Organizational objectives. Ineffective policies create confusion and may 


prevent achievement of the organizational objective. 


13 


E DOE ARTE O DEPENSE QUALITY ASSURANCE POLICY 


A. SOURCE | \ 

The primary source of policy guidance concerning Quality Assurance 
is the Assistant Secretary of Defense for Installations and Logistics (I&L). 
The primary implementing directive is Department of Defense Directive 
4155.1 of February 9, 1972. Further policy direction is contained in the 
Armed Services Procurement Regulations (ASPR). A copy of this directive 
is provided in Appendix A. | 

DoD Directive 4155.1 of February 9, 1972 represents a consolida- 
tion of some twelve DoD Instructions issued as early as 1957. This con- 
solidation reflecting the principle of consistency in establishing effective 
policies has clarified current DoD policies regarding Quality Assurance. 
This is a substantial change from the former maze of direction that exist- d 
in prior years. 

DoD Directive 4155.1 provides for the review of Quality Assuranc 
policies by a DoD Quality Assurance Council composed of one General or 
Flag rank officer and one senior civilian from each Military Department 
and the Defense Supply Agency (DSA). The Council shall be chaired by a 
representative of the ASD (I&L) and will provide consultation and advice 
to the ASD (I&L) on quality assurance matters. 

SECNAVINST 4355.14 of August 7, 1972 implements DoD Directive 
4155.1 of February 9, 1972. The Chief of Naval Material is designated 
to ensure compliance with the provisions of DoD Directive 4155.1 and to 
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develop and issue supplemental policies, instructions, and criteria. 
Although a supplemental NAVMAT INSTRUCTION is under preparation, 


issuance is not expected before March 1973. 


B. PURPOSE OF QUALITY ASSURANCE 
1. Enforcement of Technical Criteria 
The primary purpose of quality assurance as defined by DoD 
Directive 4155.1 is the enforcement of technical criteria and requirements 
governing all materials, data, supplies and services developed, procured, 
produced, stored, operated, maintained, overhauled, or disposed of, by, 
Or the Department of Defense. [Ref. 4] 
2. The Functional Organization Responsibilities 
The functional organization which creates technical criteria 
is responsible for the translation of functional requirements including 
reliability and maintainability into quantitative requirements that can be 


contractually specified and demonstrated. 


E. DEPARTMENT OF DEFENSE QUALITY ASSURANCE POLICY 
ie General 
a. Objective Evidence Required 
Determination that materials, datz, supplies and services 
meet requirements shall be based on objective evidence, which may in- 
clude direct product examination and test, review of procedures, processes, 
records and documentation. The results are retained for corrective active 


purposes. Where feasible, functional tests of the end product in a real 
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or simulated environment are required to confirm that performance and 
quality requirements are met. 
be selection of Degree and Type 
The degree and type of quality assurance provided during 
the life of the product is varied to assure mission responsiveness. 
es Defect Prevention 
Defect Prevention requires timely and integrated plan- 
ning, monitoring of appropriate procedures, systems and resources and 
the correction of causes of deficiencies. 
a Feedback 
Feedback is the mechanism in a control system that 
enables the top management to assess the success or failure of policies. 
From this assessment management is able to take corrective action to 
achieve the desired results. Specifically ASD (I&L) has directed the 
Military Departments and DSA to establish an information system that will 
feedback quality information to activities responsible for development, 
procurement, and other management functions so that they can initiate 
action nie correct or prevent quality deficiencies. 
on Civilian Personnel 
The DoD-wide Civilian Career Program for Quality and 
Reliability Assurance to assure maximum employee efficiency and career 
development will be continued. A description of the technical training 
Program is contained in DoD Manual 1430.10-M-2, "DoD-Wide Civilian 
Career Program for Quality and Reliability Assurance Personnel," February 


en. 
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f Audits 
Quality audits of materials, data, supplies and serv- 
ices shall be conducted. 
g: Calibration 
The contractor shall establish and maintain a system 
for the calibration of all measuring and test equipment used in fulfillment 
of his contractual requirements. Measurement accuracies shall be trace- 
able to U. S. National Standards maintained by the National Bureau of 
Standards. 
2, Procurement 
a. Contractor's Responsibilities 
DoD Diráctive 4155.1 of February 9, 1972 [Ref. 4] 
defines contractor responsibility in the following manner: "Contractors 
are responsible for (a) controlling product quality, (b) offering to the 
government for acceptance only material, data, supplies and services tr t 
conform to contract requirements, and (c) when required, maintaining ar 
furnishing substantiating evidence of this conformance." 
D: Department of Defense Responsibilities 
The Military Departments and DSA are responsible for 
ensuring that contracts specify the appropriate quality requirements. 
Assignment of contract administrative functions to ensure contractors 
comply with quality requirements shall be made in accordance with the 


Department of Defense Plant Cognizance Program. 
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Ce Subcontracts 
Government procurement quality assurance at the sub- 
contractor plant shall be performed only when necessary to assist the 
contract administration office cognizant at the prime contractor's plant. 
These actions do not relieve the prime contractor of any of his responsi- 
bilities under the contract and do not establish any contractual relations 
between the Government and the subcontractor. 
ce Armed Services Procurement Regulation 
Procurement quality assurance policies contained in 
DoD 4155.1 are implemented by the Armed Services Procurement Regula- 
Mons (ASPR). 
3. Development (R & D) 
a. Early Stages 
Quality Assurance shall be considered early in the 
design stage to obtain maximum benefits with regards to tradeoffs of 
quality requirements for cost, schedule, and performance parameters. 
b. eier: 
During the development of the specifications: standards, 
inspections, and tests shall be required to ensure the production process 
does not degrade system performance. 


4. Standardized Procedures 





Although quality assurance policy has been standardized, 
contract administration procedures have not been standardized. References 


7 and 15 are but two of several procedures manuals used at the current 
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time by Naval activities. Although there is a real need for product 
standardization, previous attempts have failed to be accepted by the 
Military Departments and even by different organizations within each 
service. Currently DSA and the Military Departments are in the final 
stages of drafting a coordinated common procedural manual, DSA 8200.1 
Series. This manual would greatly simplify contract administration and 
the understanding of contract administration within DoD. 

One immediate consequence of a standard contract adminis- 
tration manual would be the ability to audit and evaluate the various 
contract administration agencies. The purpose of such an audit would be 
the same as any major operational inspection (Operating Readiness Inspec- 
tion, Nuclear Technical Proficiency Inspection, Operation Reactors Safe- 

- guard Exam, etc.) and the effect would be to improve the quality of con- 
tract administration functions by enforcing standards procedures. Currently 
ASPR 3-801.5 [ Ref. 2] provides for audits of contractors' implementation 
of quality assurance procedures but not of the contract administration it- 
self. If implemented properly, audits of contract administration could 
improve their performance. Good ideas of better procedures could be 
transferred from one office to another and even from one Military Depart- 


ment to another through communication of audit board results and findings. 
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V. QUALITY ASSURANCE DURING SYSTEM PROCUREMENT 


A. PROCUREMENT PLANNING FOR QUALITY ASSURANCE 
l. Specification 

In a formal sense, specifications are descriptions of the 
technical and other system requirements that establish the parameters of 
the design, performance, construction, and physical characteristics of 
the end product. When, because of insufficient time or knowledge, or 
because of the complexity of the product involved, it is impossible to 
prepare a formal specification, ASPR [Ref. 2) permits the use of a pur- 
chase description which defines the essential characteristics and functions 
of the system. 

Complex military systems are generally produced under per- 
formance specifications, because it is not feasible to define anything 
more than the performance objectives and general characteristics of th: 
desired work. Prior to the commencement of the production the contrac or 
is required to develop design specifications and a data package to ensure 
that the required quality and performance of the system is not downgraded 
by the production process. 

2% Technical/Contract Personnel Interface 

The contracting officer who is charged by regulation with 
responsibilities for entering into contracts binding upon the government 
is the spokesman to Industry for the procurement team. Although the con- 
tracting officer has the authority to represent the Government in the 
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execution of contracts, to authorize and negotiate change orders, to grant 
time extensions, to accept items, to authorize payment, to issue termina- 
tion for default or convenience of the Government, and to negotiate settle- 
ments owing convenience terminations, the contracting officer requires 
the assistance of many personnel (lawyers, technical, quality assurance, 
and Small Business specialists, etc.) to successfully complete contract 
arrangements. 

The difficulty in the team approach may be parochial in nature. 
The technical specialist views the contracting officer and ASPR as an 
impediment to progress whereas the contracting officer views the techni- 
cal specialists as emphasizing technical quality to the exclusion of 
everything else -- contractor past performance history, schedule, lead 
times, competition, etc. In reality cal and contracting personnel 
must work together as a team to most efficiently discharge their procure- 
ment responsibilities. Cross training courses such as the Harbridge 
House, Defense Procurement Management for Technical Personnel, have 
improved the technical/contracting personnel interface communications 
problem. 

T Technical Requirement 

Requirements for services or supplies are originated by 

the users. A procurement request (PR) is prepared and forwarded to the 
Contracting Officer. It is important for the PR to present all the informa- 
tion necessary to contract for the required services or supplies. Incom- 


plete or inaccurately documented requests must be clarified prior to 


2 





contractual action. In some cases the correction of errors may seriously 
delay timely contractual coverage or result in the procurement of unwanted 
non-conforming supplies. 

b. Quality Assurance 

The PR must contain all the quality and reliability 
requirements established for the procurement. The originator is responsible 
for reviewing these requirements as early in the preparation of the PR as 
possible. This responsibility is normally exercised by the selection of 
the appropriate ASPR clause or by citing the appropriate item specification 
in the solicitation. The selection of the quality assurance requirements 
involves important quality decisions which affect contract cost, schedule, 
and performance. 

The quality requirements selected in the solicitation 
determine the scope of the contract administration office quality assurance 
effort. For example, if the contract quality requirements for a critical or 
highly complex item are not as demanding as the item requires, the quality 
assurance representative (QAR) cannot insist on more rigid quality controls 
considered necessary without obtaining a change order to the contract from 
the procurement contracting officer. 

The Joint Commanders' Panel on Contract Administration 
[Ref. 10] ina report on quality assurance dated 24 March 1971 found 
the "Contract requirements are frequently established with little or no 
input from the quality assurance personnel and technical data packages 


do not receive adequate pre-procurement technical reviews by quality 
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assurance personnel." The panel's report emphasized the importance of 
the quality assurance input by recommending a change in the organizational 
location of the quality assurance function to assure a quality input into 
the procurement process. This would include review of quality assurance 
requirements to be included in solicitations and a review of contractual 
technical data packages. 
C, Contract Type 
The contract type is one of the most important decisions 
for the Contracting Officer and Project Manager. The fixed price type 
contract motivates the contractor to produce the end item at the least 
possible cost and is the desired type of contract where a good technical 
data package exists. EL in a developmental type situation where 
the Government desires the right to exercise technical direction, a cost 
type contract is more appropriate. Thus the Project Manager should seek 
the advice of the lawyer, contracting officer, and technical experts in 
selecting the type of contract most appropriate for the requiren 2nts of tI : 
program including the degree of technical and financial risk, both to the 
Government and contractor. More specific guidance is provided by 
SECNAV INST 5000.1 [Ref. 21] which states: 
Contract type shall be consistent with all program character- 

Metics including risk. It is not possible to determine the precise 

production cost of a new complex defense system before itis 

developed; therefore such systems will not be procured using the 

total package procurement concept or options that are contractually 

priced in the development contract. Cost type prime and sub- 


contracts are preferred where substantial development effort is 
involved. Letter contracts shall be minimized. When risk is 
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reduced to the extent that realistic pricing can occur, fixed- 

Dice type contacts should be issued. Changes shall be limited 

to those that are necessary or Offer significant benefits to DoD. 

Where change orders are necessary, they shall be contractually 

priced or subject to an established ceiling before authorization, 

except in patently impractical cases. 

3. Primes Response/Proposal 
When the Contracting Officer understands the requirements of 
¡he PR and has determined the appropriate method of procurement, the next 
step in the contracting process is to establish a definitive list of sources 
from which bids, or proposals, should be solicited. The development of 
this list requires inputs from contracting, engineering, and technical 
personnel. From this list of sources the Contracting Officer prepares a 
formal solicitation package which is mailed to the firms on the source 
list. The solicitation package contains the Invitation for Bid (IFB) or the 
Request for Proposal (RFP), the schedule, the pertinent General Provisions 
for the type of Contract anticipated, any other terms or conditions pertinent 
to the procurement or that will be used to evaluate offers received, perti- 
nent specifications, drawing and other technical data, and cost and price 
analysis forms for negotiated procurements. 
Upon receipt and evaluation of the solicitation package a 

firm that desires to submit a bid breaks the solicitation down into manage- 
able work packages or elements which can be priced out. One breakdown 
is in the quality assurance area. The prime contractor takes the quality 


requirements and breaks it down into a program plan. This plan is priced 


Out and becomes part of the company's proposal which is submitted to the 


Government for evaluation. 
24 





In the case of an Invitation for Bid, the firm with the lowest 
responsive, responsible bid, price and other facts considered, wins the 
contract. In the case of a negotiated procurement the firm who submits 
the best proposal becomes the prime contractor. 

4. Source Selection 

Meaningful source selection requires thorough evaluation and 
comparison of all relevant factors, both technical and nontechnical. This 
evaluation can only be achieved through teamwork between technical and 
contracting personnel. After the proposals have been evaluated, the 
results must be analyzed together with the business qualifications of the 
sources in order to determine which offer is most acceptable to the 
government, taking into consideration all pertinent factors (technical 
merits, price, planned deliveries, etc.) and whether the contractor sub- 
mitting the most acceptable offer is fully qualified in all respects (techni- 
cally, financially, productively, etc.) to perform satisfactorily under the 
contract. 

D. ten 

Ina competitive situation the Contracting Officer may accept 
the offer made in response to the Request for Proposal if the price is 
deemed to be fair and reasonable. However, in complex procurements 
where there is a question to the reasonableness of the price, or there are 
misunderstandings, or there is only one source, then the Contracting 
Officer will conduct negotiations. An example of a misunderstanding might 


be in the extent of quality assurance effort required to meet the 
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requirements of the contract. Upon completion of the negotiations a 


contract is prepared and signed. 


B. CONTRACT ADMINISTRATION--QUALITY ASSURANCE AT THE PIANT 
MEVEL 
l., General 
a. Post Award Conference 
ASPR 1-1803.4 [Ref. 2] states: "It is essential that 
all parties involved in the execution, administration, and performance of 
a government contract have a clear and mutual understanding of the scope 
of the contract, the technical requirements ..." The method used ona 
selective basis by Contract Administration Offices is to conduct a post 
award conference with the contractor to discuss and reach a common 
understanding of the technical requirements. The interaction between 
technical, contract administration and contractor personnel results in a: 
improved knowledge of the requirements. Poorly defined items are inter 
preted for the contractor and the Contract Administration Organization. 
The result is to prevent action that could result in delays or cost growth. 
b. Procedures Review . 
Procedures review is applicable when the contract 
requires documented quality or inspection procedures. The OAR reviews 
these dures prior to production and at periodic intervals to ensure 


compliance with contract terms. 
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er Procedures Evaluation 
Procedures evaluation provides for the continuing assess- 
ment of the contractor's compliance with his previously reviewed and docu- 
mented procedures. 
ds Product Verification Inspection 
Product verification inspection provides for a degree of 
independent physical product En by the QAR. The intensity of the 
product inspection depends on the contractor's quality control history. 
e. Contractor Decision Verification 
The contractor decision verification concept is used to 
assess the validity of the contractor's inspection decisions. A random 
sample is selected from items previously approved by the contractor's 
inspectors for the purpose of assuring that the contractor's quality program 
or inspection system satisfactorily controls the quality of the product. 
Currently the Military Departments and the Defense Supply Agency (DSA) 
are in the final stages of drafting a coordinated procedural manual, DSA 
8200.1 Series, Guidelines for Contract Administration, which may delete 
mis Concept. 
fja Corrective Action 
Five levels of corrective action measures are provided 
to assure that the contractor corrects the cause of deficiencies discovered 
during contract administration. These measures increase in severity 
from immediate correction to recommendations to the administrative con- 


tracting Officer that acceptance be withheld pending evidence that the 


Gemiuactor nas taken corrective action. 
2 








g. Quality Assurance Representative 
Interviews were conducted with quality assurance 

personnel from the Defense Contract Audit Service (DCAS), an ordinance 
Naval Plant Representative Officer (NAVPRO), and with a large government 
contractor. interview results indicated that without specific commodity 
guidance the successful implementation of product quality assurance 
procedures (PQAP) is dependent upon the ability of the QAR's to exercise 
technical judgements and system approval. The quality assurance con- 
cept requires a skilled quality manager who has considerable product 
experience. The need for increased training of quality assurance personnel 
has been recognized in several Department of Defense sponsored studies 
ete s,9, 10} and a DoD career training program has been established 
to remedy scme of these deficiencies. The current DoD program is slanted 
toward Technician level training and does not include professional such 
as engineers and statisticians. A program for professional personnel mit 
be implemented to enable engineers and statisticians to keep abreast of 
new technologies with ne in Quality Assurance. 

| The most serious area of inconsistency is in the evalua- 
tion and approval of a contractor's quality program. Reference 11 grants 
the QAR the responsibility for determining that contractual requirements 
have, in fact, been complied with prior to acceptance of the product. In 
practice the quality of the approved system is directly dependent on the 
skill and knowledge of the QAR. As a result, contractor implementation of 


MILSTD 9858A, Quality Program Requirements, depends on the QAR. 
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Specific procedures may vary from plant to plant within the same firm, 
often to the disadvantage of the aes There is a need to standard- 
ize product assurance quality procedures to ensure the government gets 
full benefit from product assurance dollars. An example of inconsistency 
in the area of product inspection cited in Ref. 10 is as follows: "Under 
current PQAP, the degree of government product inspection is largely within 
the province of QAR judgements and it is likely that different QAR's would 
each conduct a different degree of product inspection for the same product, 
at the same plant. A more disciplined approach could lead to an even- 
handed program, where management could more readily assess QAR per- 
formance at plant level." 
2: Quality Assurance -- Subcontract Level 
a. Policy | 

Government policy is that the contractor is responsible 
to the Government for compliance with total contract requirements including 
that of assuring the quality of subcontract or vendor parts. More specifi- 
cally the mandatory contractor Responsibility For Inspection (1968 SEP) 
clause contained in the ASPR (Ref. 2] states: 

Notwithstanding the requirements for any Government inspection 
and test contained in the specification applicable to the contract, 
except where specialized inspections and tests are specified for 
performance solely by the Government, the Contractor shall perform 
or have performed the inspections and tests required to substantiate 
that the supplies and services provided under the contract require- 


ments listed herein, including if applicable the technical require- 
ments for the manufactorers' part number specified herein. 


Government procurement quality assurance is performed 
A subcontractor plants only at the request of the contract administration 
office cognizant at the prime contractor's plant. These actions do not 
relieve the prime contractor of any of his responsibilities under the con- 
tract and do not establish any contractual relationship between the 
Government and the subcontractor. ASPR 14-305.2 [Ref. 2 ] lists the 
prerequisite conditions for delegation of contract administration responsi- 
bilities. The essential conditions are listed below: 

(1) Application of Inspection System or Quality Program. 
When a contract requires EEE tor to establish or maintain an inspec- 
tion system (MIL-I-45208A) or a quality program (MIL-Q-9858A), ASPR 
allows Government procurement quality assurance actions to be performed 
at the source. 

(2) Uneconomical Disassembly or Destructive Testing. 
ASPR requires Government procurement quality assurance sen to be 
performed at the source when performance of such actions at any other 
point would require uneconomical disassembly or destructive testing. 

(3) Loss to Government. ASPR requires Government 
procurement quality assurance actions to be performed at the source when 
considerable loss to the Government would result from the manufacture 
and shipment of unacceptable supplies or from the delay in making 


necessary corrections. 


(4) SpecialInstruments, Gauges, orFacilities Required. 





ASPR requires Government procurement quality assurance actions to be 
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performed at the source when special instruments, gauges, or facilities 
required for the performance of such actions are available only at the 
source. 

(5) Replacement of Costly Packing. ASPR requires 
Government procurement quality assurance to be performed at the source 
when performance of such actions at any other point would destroy or 
require the replacement of costly special packing and packaging. 

(6) Essential Nature. ASPR requires Government 
procurement quality assurance actions to be performed at the source when 
it is essential during performance. 

(7) Overseas Embarkation. ASPR requires Government 
procurement quelity assurance actions to be performed at the source when 
supplies are destined for points cf een for overseas shipment. 

(8) | Otherwise in Pest Interest. ASPR requires 
Government procurement quality assurance actions to be perfcrmed at the 
source when it is otherwise determined to be in the best interest of the 
Government. | 

Beszsubeentraet Quality Assurance Problems 

(1) Prime Contractor Control. Although the contractor 
has always been responsible to the Government for control of product 
quality, in practice many contractors have relied heavily on government 
inspection at subcontract facilities for assurance of quality of sub- 
contract or vendor parts. This is particularly true for parts procured 


under a military specification because the specification is written and 
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controlled by the Government. In addition to performing required part 
qualification test, section 4 of the specifications generally requires that 
the Government perform the inspection. In addition to duplicating 
Government facilities and functions, the maintenance of adequate con- 
trols over Mil Spec parts is expensive. 

During the last five years the declining Operating 
and Maintenance Funds (O&M) has forced a reduction in the number of 
government inspectors available for subcontract inspection. Thereiore 
it is the policy of the Government to require the contractor to assume 
complete responsibility for the quality of parts produced by his vendors 
and subcontractors. The government's withdrawal from subcontract 
inspection has left a void that many contractors are reluctant to fill, 
especially in competitive type procurement where award is made on the 
basis of price alone. Even in negotiated type procurement the number of 
dollars a contractor is willing to expend on subcontract quality assurance 
effort depends to a large extent on what the negotiator and the procure- 
ment contracting officer are willing to allow. Thus the only situation 
in which a contractor is willing to do an adequate job in subcontract 
quality assurance effort is in the sole source type procurement where the 
requiring activity demands and is willing to pay for the quality assurance 
effort. The driving factor in all these situations is the competitive situ- 
atión Of the firm with respect to its competitors. It is unrealistic for 
the Government to expect to be able to shift the responsibilities for sub- 
contract quality assurance activities to the contractor without a substan- 


tial increase in price. 20 





The consequences of effectively implementing this 
policy areimmediately obvious. Ina hypothetical case of two contractors 
procuring a common aircraft engine, each contractor is required to ensure 
that adequate process controls are applied to the subcontractor's produc- 
tion line. Assuming agreement can be reached over what constitutes 
"adequate controls," each contractor must establish and maintain quality 
assurance control personnel at the contractor's facility essentially dup- 
licating each other's quality assurance effort. Essentially, the Govern- 
ment is paying each contractor to duplicate the quality assurance effort 
at this subcontractor's plant. This duplication and waste of product 
assurance dollars would be complicated by lack of a standardized product 
assurance quality procedure (PAQP). 

The establishment of a Transfer Fund similar in 
concept to the Naval Industrial Fund has been proposed in Refs. 3 and 
10 as a solution to the problem of declining O&M funds on the reducti: 1 
of numbers of Government Inspectors. Insufficient contract ~dministré - 
tion personnel has ee n the cost of System Acquisition because of 
the Pe cessity for paying the contractor for quality control formerly per- 
formed by the Government. Another problem is in the difficulties in 
assignment of contract administration tasks to contract administration 
Offices cognizant at the subcontractor plant because of insufficient 
personnel. The establishment of a Transfer Payment system similar to 
the Industrial Stock Fund would allow the Project Manager who requires 


contract administration performed at a subcontractor's plant in accordance 
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with the ASPR guidelines to contract and pay the cognizant contract 
administration office for the desired services. This in turn would allow 
the contract administration office to acquire the required personnel to 
perform the requirement. This proposal has been discussed by ASD (I&L) 
and studied by his quality assurance policy board but the results have not 
been released. 

Another approach to improving vendor control is 
being developed by the Vendor-Vendee Technical Committee of the 
American Society for Quality Control (ASQC). The approach of the com- 
mittee is analogous to the concept for the Underwriters Laboratories seal 
for electrical apparatus and components. The ASQC program contemplates 
a vendor fee supported system of surveys of in-house quality programs, 
and the award of a seal with periodic reer The potential of this 
program for reducing government and contractor quality assurance costs 
warrants government support. 

(2) Project Manager Control. The Project Manager 
makes many visits to Eee and subcontractor facilities to assess 
progress. One recurring problem is to ensure the quality assurance pro- 
visions of the contract are met when Government contract administration 
personnel at the subcontractor plants are unable to perform surveillance 
because they do not have adequate training and experience or do not have 
sufficient personnel. When problems develop the Project Manager asks 
the contractor to resolve the issue. If the contractor is unable to correct 


the problem, the Project Manager is not able to force compliance 
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without a contract modification. Almost any other action can be construed 
as a constructive change order which will result in a claim against the 


Government. 
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VI. QUALITY ASSURANCE--AREAS NEEDING IMPROVEMENT 


A. ASPR - REGULATORY EFFECT 

When a problem arises or incident occurs in the procurement cycle, 
the reaction is to establish a regulation which will prevent this problem 
from ever Occurring again. DoD Contract Management Conference, 
ieee? '73, [| Refi. 3 ] in discussing the regulatory effect of ASPR 
Observed, "It should be recognized, however, that with each regulation 
that is incorporated into ASPR a 'freedom' is given up. ASPR more fre- 
quently seems to be the reason for saying 'no' rather than the regulatory 
document which supports 'getting the job done' ." 

Before considering a new regulation, each incident should be care- 
fully analyzed to determine why the situation occurred. For example, the 
problem for the occurrence might be attributed to insufficient or imprope~ 
Cening, Supervision, or inexperience which would indicate a different 
sOlution than that required by change ina public law. The ASPR might 


better be limited to broad guidance rather than providing specific policy 


procedures. 


B. TECHNICAL DATA DEFICIENCIES 

The Technical Data Package (TDP) is the method used in the procure- 
ment process to convey DoD technical requirements to the contractor. The 
TDP must transmit to competing bidders the technical knowhow required to 


produce the end product. An inadequate TDP requires the successful 
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contractor to perform.Resrarch and Development (R&D) to once again 
resOlve the technical problem previously overcome. The first Joint 
Commanders Panel [Ref. 10] in their discussion on deficient TDP's 
stated: 
From a practical standpoint, transfer of technology through 
specifications, standards and drawings is a most difficult, and 
at times, an almost impossible task. Obviously, whentechnology 
is complex and pushing the state-of-the-art, it becomes increas- 
ingly difficult to expect the documentation alone can convey the 
item requirement. Nevertheless, in DoD procurement, the 
Technical Data Package is generally assumed to be a perfect 
communications vehicle. DoD appears to operate on the precept 
that any qualified bidder can readily comprehend the technical 
documents presented to him, and with equal facility can readily 
produce the item without a specified schedule timeframe. When 
problems develop, but are undetected by the contractor, thew DoD 
QAR, not having been involved during development, is not «wuipped 
to provide the assistance required or even notify the contrector 
that a problem has arisen. 

Evidence of technical data deficiencies has been showm by formal 
reviews, many-contract board appeals cases, the numbers of change 
orders issued. Recently a review of Army contract appeal cases over a 
one year period showed that 85% [ Ref. 3] involved technical data 
problems such as a conflict in technical requirements, impos:stsility to 
meet requirements, or missing data. A review of technical dat packages 
released for competitive procurements revealed similar technical defici- 
encies. For example, in one package containing 1200 drawings, 195 
mandatory engineering changes were required to eliminate deficiencies 


ferer. 3 j. These technical data problems can be classified into three 


general groups. They are as follows: 
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l, Craftsman Errors 


2. Engineering Deficiencies 


3. Improper Use of Technical Data 


These categories are identified in Table I reproduced from Ref. 1. 
Improving the quality of technical data requires specific actions 
similar to controlling the quality of hardware. The contractor should be 
required to establish quality control procedures to measure and control 
the accuracy and adequacy of technical data in the preparation of the RFP. 
The role of the government contract administration representative should 
be that of review and approval of the contractor's system rather than 
that of approving the individual documents. The current practice requires 
almost all documents to be submitted to the government for approval. For 
example, in Shipbuilding this leads to an enormous workload for the 
Supervisor of Shipbuilding (SUPSHIPS) which is very expensive in terms 
of personnel. The elimination of this concept would not only give the 
Supervisor of Shipbuilding more time to administer government contracts 
but would lead to improved data packages since review would be on the 
exception basis and correction required in unsatisfactory procedures rather 
than in the individual data elements. Inthe past few years several 
attempts have been made to develop a military specification or standard 
to prescribe the quality controls contractors must maintain to assure 
accuracy and technical adequacy of the technical data presented to DoD 
under tne terms of the contract, but tnese efforts failed when the services 


and DSA were unable to agree on a final document. Prior to implementing 
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TABLE 1--TECH NICAL DATA DEFICIENCIES 


CIASS EVIDENCE 
DAS RAFTS MA NS HIP ERRORS 
Illegible or missing data ACO and PCO 
Reviews 


@ovrous conflicts in 
requirements 


Contract clause improper 


Packaging or marking 
requirements omitted 
(type II changes) 


Pome NGINEERING DEFICIENCIES 


Processes & assembly Industry 

data omitted complaint 
Inadequate performance Contract Board 
requirements of Appeals 
Improper Test Technical Data 
Specifications review 


Parts or Subassembly 
interference 


Wrong part specified 

Changes not incorporated 

(type I changes) 
BEZEIMEROPER USE OF TECH DATA 


Transfer of Industrial Same as above 
technology 


Data not suited for 
competition 


CAUSE 


CONTRACTOR 


Poor drafting 
practices 


No OC 


GOVERN MENT 


No QA 


CONTRACTOR 


Same as above 


Poor configuration 
control 


GOVERN MENT 


No QA 


PACI 


Unnatural use 
of data 


Source: 1968 DoD Contract Management Conference IMPACT--73 [Ref. 3] 
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procedures for improving the quality of technical data, it is essential for 
the Service and DSA to agree on a standard for the control of technical 


data. 


OF SMALL BUSINESS PROGRAM 

The Department of Defense is firmly committed to implementing the 
Small Business Act in defense procurement. Proposed procurements are 
reviewed for Small Business participation to the maximum extent possible 
and where it is impractical DoD requires the Prime Contractor to maintain 
a Small Business Program. 

Small Business firms have proved that they can successfully submit 
bids and win contracts in areas in which they are competent. The diffi- 
culty is in the lack of familiarity with Government procurement, including 
subcontracting and the need for help and assistance of both the Govern- 
ment and the prime contractor in securing contracts and performing their 
work. This is particularly applicable to reliability and quality control 
programs where Government requirements are more stringent than commer- 
cial ecards. 

Quality eE. technical, and ereeurement personnel must 
recognize this problem and plan to commit the resources and personnel 
necessary to assist Small Business firms in producing acceptable products 
for the Government. The necessity for committing these resources is an 
rzeeption to government policy but it is necessary to ensure the success 


of the Small Business Program. 
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pr PUBLIC LAW 92-156 

Section 506 of Public Law 92-156 [ Ref. 18 ] enacted November 
17, 1971 requires "report data on operational testing and evaluation for 
each weapon system for which funds for procurement are requested” 
commencing January 1, 1973. A supplemental report to Congress is 
required between thirty and sixty days prior to the award of a contract 
or exercising an option within a contract. The primary effect of Public 
Law 92-156 is to require accomplishment of Initial Operational Test and 
Evaluation (IOT&E) prior to the major production decision point to permit 
assessment of the operational effectiveness and suitability of a weapon 
system. 

The Navy (COMOPTEVFOR) is currently developing procedures for 
implementing the requirements of PL 92-156. Although these procedures 
will affect developmental schedules, the goal is to improve reliability, 
maintainability, supportability, and operability elements of the system 


prior to commencing full scale development. 


E. WARRANTIES AND THE INSPECTION CLAUSE 

Although warranties have a considerable impact on proposed procure- 
ments, the Project Manager probably is not aware that in specifying 
either MIL-1-45208A or MIL-Q-9858A for quality Es ÓN 
effect the implementing ASPR clause abdicates any expressed warranty. 
Department of Defense policy requires contractors to control product qual- 


ity and to offer to the Government, for acceptance, only those supplies 
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and services that conform to contractual requirements and, when required, 
for maintaining and furnishing substantiating evidence of this conformance. 
Thus determination that materials, data, supplies, and services meet 
requirements for acceptance is sometimes based on objective evidence 
furnished by the contractor by procedures approved by the QAR. The crux 
of the problem lies in the acceptance of the supplies delivered in accord- 
ance with the approved system that subsequently are discovered to be 
defective. Inthe absence of the Inspection clause the Government 
requires contractors to correct or replace defective supplies. The Inspec- 
tion clause [ Ref. 2 ] covers the Government's rights to inspect, to 
reject, to require correction of defects, to accept items at a reduction in 
price and after making the provisions relative to inspection continues: 
The inspection and test by the sora of any supplies 

or lots thereof does not relieve the contractor from any responsi- 

bility regarding defects or other failures to meet the contract 

requirements which may be discovered prior to acceptance. 

Except as otherwise provided in this contract, acceptance shall 

be conclusive except as regards latent defects, fraud, or such 

gross mistakes as amount to fraud. 
Furthermore ASPR 14-306 (b) [Ref. 2 ] provides that when inspection is 
at ein. supplies may not be reinspected at destination for acceptance 
purposes, rather they are to be examined only for identity, damagein 
transit, quantity and condition. Normally acceptance is evidenced by 
the execution of an acceptance certificate on the applicable inspection 
and receiving report form (DD Form 250, 1155, or Standard Form 44). Thus 


mire “Allison Honer Co." case the Armed Services Board of Contract 


Appeal (ASBCA) held that "in the absence of latent defects, fraud, or 
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gross mistake, acceptance of work per formal written certificate and final 
payment precluded the government from claiming the value of disputed 
work which the contractor did not perform." [Ref. 16 ] 

In ASBCA 9934 involving the Republic Aviation Corporation, the 
Board of Contract Appeals ruled that oral expressed warranties given by 
the contractor did not survive acceptance. Although the ASPR inspection 
clause was included in the contract, the Government contended that 
implied warranty survived acceptance. In making this determination the 
Board ruled that: 

Phere is no contention that a latent defect, fraud or gross 
mistake amounting to fraud are involved here. Acceptance was 
conclusive, therefore, unless it was ‘otherwise provided in 
this contract'. There is not written warranty or any other pro- 
vision in the contract which provides ‘otherwise’. The 
Government does not refer to the contract specification 
regarding prevention of chafing but these are not warranties 
which survive acceptance. Oral warranties outside the contract 
likewise are not covered by the exception. [Ref. 22] 

This case emphasized the point that express warranties do not survive 
acceptance because they are not provided for or written in the contract. 
One method of remedy for the deficiencies in the Inspection clause 
is through the inclusion of the Warranty of Supplies clause found in 
ESPR 1-324.7 (d) [ Ref. 2 1 This clause provides that "Notwithstanding 
inspection and acceptance" the contractor warrants the supplies will be 
free from defects in materials and workmanship and will conform to con- 
tract specifications. The remedies provided for breach of this express 


warrenty survive inspection and acceptance by the Government. In 


considering the Warranty clause for inclusion in a contract, the Project 
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Manager and the Procurement Contracting Officer must follow the ASPR 
Guidelines which requires an affirmative determination that the potential 
increase in contract price is outweighed by the benefits obtained for the 
Government. 

The Inspection Clause which was adequate when DoD performed 
the inspection is not appropriate for current Department of Defense policy 
of placing responsibility for quality on its contractors because government 
acceptance relieves contractors of this responsibility. References 3 and 
10 recommend updating the quality assurance clauses to reflect the mean- 
ing to the contractors' responsibility concept, i.e., reducing the finality 
of acceptance. The current inspection clause has remained unchanged 
for over twenty years and no longer is appropriate for current Department 


of Defense policy. 
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ieee ton IMPLICATION OF QUALITY ASSURANCE POLICIES 


AND PROCEDURES FOR PROJECT MANAGERS 


Department of Defense policy toward project management is to 
assign a single individual (Project Manager) the responsibility and author- 
ity for accomplishing recognized program objectives in the development 
and production of major Weapon Systems. The concept is to provide 
centralized management authority over all of the technical and business 
aspects of the program. 

The early conceptual effort is perhaps the most important stage to 
the Project Manager for project success. Decisions made here are not 
easily reversed or corrected in production. The Project Manager should 
seek the advice of lawyers, contracting officers, and technical experts 
in the development of an Acquisition and Management plan. 

Although Ref. 21 allows NAVPRO/SUPSHIPS personnel to participate 
mtne precontract award phases of the RFP preparation the Project Manager 
should establish direct liaison with appropriate elements in the NAVPRO/ 
SUPSHIPS/DCAS activity at the prime contractor's plant. Reference 21 
specifies that "agreements shall be reached between responsible Head- 
quarters elements and applicable NAVPRO/SUPSHIPS authorities with 
respect to the responsibility of each relative to specific acquisition pro- 
grams.” The advantage of reaching an early agreement is that the contract 
administration activity will have more time to engage and monitor the 
contractor's activities. This information can be used to supplement 
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information presented by the contractor pursuant to contractual clauses. 
When problems occur, the contract administration office can request 
assistance from headquarters whose personnel have more expertise. The 
benefits can best be viewed from the experience at NAVPRO, Sunnyvale, 
where engagement has been the rule rather than the exception. Government 
personnel are well informed on the contractor's progress which allows the 
Project Manager to make better program decisions. The resultant clear 
assignment of responsibility allows potential problems to be identified 
and solutions obtained earlier during the developmental and production 
cycle than in other comparable projects without as much engagement. 
This is one of the reasons for the phenomenal success of the quality assur- 
ance program in the Polaris and Poseidon programs and it is a solution that 
does not require large amounts of product seltene dollars. The objective 
of the Project Manager is to get perscnnel from the contract administration 
agency to act on his team as ne specialists from headquarter activi- 
ties to ensure the success of his project. Another technique that the 
Project Manager can ee to accomplish this purpose is to assign a techni- 
cal tive to the cognizant Contract Administration Office. 
Department of Defense Instruction 4105.64, Technical Representa- 
tion at Contractors' Facilities [Ref. 5] , contains DoD policies concern- 
ing attachment of technical representatives (Tech Reps) to DoD Contract 
Administration offices by other DoD components. In general the Project 
Manager may exercise technical direction and control of a aoe ata 


contractor's plant through the following methods: 
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(1) Plant cognizance may be assigned on the basis of 

his program as in the Polaris/Poseidon Program, or 
(2) The Project Manager may rely on the cognizant 

Contract Administration Office to meet his require- 

a i.e., the Project Manager can delegate 

technical authority to the Contract Administration 

Office, or 
(3) The Project Manager may assign Tech Reps to the 

Contract Administration Office. 

To the maximum extent possible DoD policy requires tne Project 
Manager to delegate his technical functions requiring performance at the 
Contractor's plant to the cognizant Contract Administration agency. 
However, if the Project Manager determines that the technical require- 
ments cannot be satisfied by relying on Contract Administration Service 
components, the Project Manager may attach Tech Reps to the Contract 
Administration Office to perform their own technical functions, to perform 
liaison, and to ee guidance and assistance to the Contract Adminis- 
on Office. The key to success is the recognition that the Project 
Manager must rely on the Contract Administration Office to administer his 
contract. By considering this problem early in the conceptual stages of 
the project, it is possible for the Project Manager and the Contract 
Administration Office to reach an agreement concerning level of efforts 
and responsibilities of each relative to specific acquisition programs. 


The importance of the Contract Administration agency is emphasized by 
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its role in acting "as the authoritative interface with the contractors 
on all matters affecting performance on existing or proposed contracts.” 


[Ret. 21] 


u 
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VIII. CONCLUSIONS AND RECOMMENDATIONS 


A. POLICY 
[Bensrtment of Detense Directive 4155.1 (ASD (I&L)), "Quality 


Assurance," issued on 9 February 1972 cancelled twelve coexisting DoD 
Instructions. In addition to consolidating DoD quality assurance policy, 
the principle for establishing effective policies through consistency was 
followed. The real significance of this directive may be in marking the 
maturation of quality assurance as a prime discipline within headquarter 
activities. The clarification of quality assurance policies enables Project 


Managers responsible for implementing quality assurance provisions to 


function more effectively. 


Ba CONTRACT ADMINISTRATION 
1. General 

The Project Manager is vitally interested in the contract 
requirements and the eee of administration. Once the contract is defini- 
tized e contract administration office cognizant at the contractor's plant 
acts as the Project Manager's agent in all matters relating to performance 
under the existing contract. To achieve maximum effectiveness, the 
Project Manager should demand contract administration personnel partici- 
pation in the precontract award phase, evaluation and source selection. 
Often information presented by contract administration personnel is vital 


in obtaining the best contract terms for the proposed contract. The 


49 


interest generated by this participation will carry over into the adminis- 
tration phase and will aid the Project Manager in discharging his responsi- 
bilities toward the contract. 
2. Transfer Fund or Improved Vendor Control Concepts 
The Transfer Fund or Improved Vendor Control concepts would 
improve the subcontract administration problem and bear further considera- 
tion for future implementation. The advantage of Transfer Payments is in 
better accounting of System costs particularly for those dollars spent in 
product assurance. The advantage of the industry proposal is in possible 
savings for industry and Government. 
De Standardized Procedures 
Although quality assurance policy has been standardized, 
contract administration procedures have vn The acceptance of a common 
procedural manual, DSA 82007 T, Serics, would be a tremendous improve- 
ment and would allow for more effective and beneficial audits of contract 


administration activities. 


C. CROSS TRAINING 

section V.A. of this paper discusses the importance of the technical/ 
contract personnel interface in system procurement. One method of improv- 
ing this interface is to establish cross training courses similar ne 
Harbridge House, Defense Procurement Management for Technical 
Personnel course to communicate the difficulties inherent in contracting 


and to give the various participants an understanding of the problems 


t 
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and pressures faced by the other members of the procurement 


team. 


D. NEED FOR QA REEAXMINED 

Because the Government accounting system does not lend itself to 
allocating full costs to individual projects, it is doubtful that any one 
person, much less the Project Manager, knows the full impact of a 
particular decision. a accounting is necessary to wisely evaluate 
the alternatives of quality assurance decisions. Although a Project 
Manager may know relative magnitudes of costs associated with different 
quality assurance requirements, the full costs are hidden within the 
Defense Budget. The great benefits claimed to result a the applica- 
tion of quality assurance procedures and techniques to Weapon System 
Procurement sound very similar to claims made by proponents of Value 
Engineering or Should Cost Pricing techniques, yet the United States 
Government pays for our systems several times over in terms of what the 
Soviets or our European allies pay for similar systems. The real question 
that needs to be asked an only by the Project Manager, but by the ASD 
(I&L) and even B? Congress is as follows: Are we getting benefits com- 
mensurate with product assurance dollars? If not, the entire Weapon 
System concept at least in relation to quality assurance should be 
reexamined and simplified without losing system effectiveness. Although 
this paper does not address this issue, the question is one that is parti- 


cularly appropriate in the light of expected budgetary pressures. 
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E; PROJECT MANAGERS 

In planning his program the Project Manager needs to take a close 
look at the impact and need for and degree of quality assurance in his 
program. This requires an understanding not only of the basic DoD 
policies but also of the basic procedures by which these policies are 
implemented. The most important aspect of quality assurance is for the 
personnel within the cognizant contract administration office to engage 
their counterparts within the contractor's organization in order to identify 
and ensure solutions for problems when they arise rather than when the 
problem causes program delay or increases program cost that cannot be 
contained within the firm. 

One point the Project Manager must keep foremost in his mind is 
that quality assurance consists of those actions designed to provide 
confidence that materials conform to specified technical requirements 
and will provide optimal effectivity in the hands of the users. Ifthe pr - 
duct as delivered fails to do this, the Project Manager has faıled to pe - 
form his job properly. The inclusion of Quality Assurance specialists 
as conta in the early design and conceptual phases of a program 
can help in defining the technical requirements including the optimization 


of designs and processes. 
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APPENDIX A 


February 9, 1972 
NUMBER 4155, 1 


ASD(I&L) 





AT Department oí Defense Directive 
SUBJECT Quality Assurance 
Refs.: (a) DoD Manual 1430. 10-M-2, ''DoD-Wide Civilian 
Career Program for Quality and Reliability Assurance 
Personnel, '' February 3, 1970, authorized by DoD 
Instruction 1430.10, June 2, 1966 
(b) DoD Directive 4120.3, ''Defense Standardization 
Bropramil April 23, 1965 
(c) DoD Instruction 4115.1, ''DoD Coordinated Procure- 
ment Program = Purchase Assignments," October 14, 
1968 
(d) DoD Directive 5160.51, "Precise Time and Tine 
Interval (PTTI) Standards and Calibration Facilities 
for Use by DoD Components," August 31, 1971 
(e) DoD 4155. 12-H, "A Guide to Zero Defects,'' November 
1, 1965, authorized herein 
(£f) DoD 4105.59-H, 'DoD Directory of Contract Admini- 
stration Services Components, '' authorized by 
reference (h) 
(g) Armed Services Procurement Regulation, established 
by DoD Directive 4105.30, March 11, 1959 
(h) DoD Instruction 4105.59, "DoD Plant Cognizance Pro- 
gram, '"' August 20, 1970 
(i) DoD Directive 5000.19, "Policies for the Managemeat 
and Control of DoD Information Requirements," 
June 2, 1971 
(k) through (v) cancelled hereby and listed in enclosure 1 


I, PURPOSE 


This Directive establishes Department of Defense quality 
assurance policies designed to assure that all materiel, 
data, supplies and services developed, procured, pro- 
duced, stored, operated, maintained, overhauled, or 
disposed of by or for the DoD meet the following 
objectives. 








A. that materiel, data, supplies and services conform to 
specified requirements; 


B. that specified requirements for materiel, data, supplies 
and services are practical) and enforceable; and 


C. that user dissatisfaction and mission ineffectiveness are 
prevented and/or eliminated. 


Il, CANCELLATION 


Reference (j) will be cancelled one year after the effective date 
of this Directive. References (k) through (v) are hereby 
cancelled. 


MMSR APPLICABILITY 


The provisions of this Directive apply to the Military Departments, 
the Defense Supply Agency, the National Security Agency and the 
Defense Communications Agency (hereafter referred to collec- 
tively as ''DoD Components"), 


IV. DEFINITIONS 
Terms used in this Directive are defined in enclosure 2, 
V. RESPONSIBILITIES 


A. The Assistant Secretary of Defense (Instailations and Logistic ) 
shall provide overall policy guidance on DoD quality ıssuranc . 


B. Each DoD Component shall designate a central management 
focal point to be responsible for directing and monitoring 
quality assurance policy compliance with the provisions of 
this Directive. 


C, There is hereby established a DoD Quality Assurance Council 
composed of one General or Flag rank officer and one senior 
Civilian from each of the Military Departments and the 
Defense Supply Agency (DSA). The Council shall be chaired 
by a representative of the ASD(I&L) and will provide con- 
sultation and advice to the ASD(I&L) on quality assurance 
matters. The DoD Quality and Reliability Assurance Career 
Management Board (see DoD Manual 1430, 10-M-2; reference 
(a)) shall be a subgroup of the Council, 
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DoD Components shall, within the provisions of the Defense 
Standardization Program as outlined in DoD Directive 4120, 3 
(reference (b)), assure that all specifications and standards 
intended for implementation of the policies contained herein 
are fully coordinated. 


DoD-Wide Integrated Commodity Managers assigned respon- 
sibility under DoD Instruction 4115.1 {reference (c)) in 
collaboration with the Military Departments and DSA, shall 
develop, establish and issue uniform procedures to be 
utilized in conducting government procurement quality 
assurance (see VII.B.2., below) as appropriate. 


The Joint Logistics Commanders through the existing Joint 
Technical Coordinating Group for Metrology and Calibration 
(JTCG-METCAL) shall provide for interservice coordination 

of the DoD Calibration and Metrology Program. Its principal 
subgroup, the Calibration Coordination Group (CCG), shall be 
the DoD point of contact with the National Bureau of Standards 
on DoD requirements for calibration, and calibration engineer- 
ing services (e.g., requirements involving new equipment and 
techniques, improved accuracies, expanded ranges), see encl. 3. 


CONCEPTS 


As 


The primary purpose of quality assurance is the enforcement 
of technical criteria and requirements governing all materiel, 
data, supplies and services developed, procured, produced, 
stored, operated, maintained, overhauled or disposed of by or 
for the DoD. 


Functional organizations creating technical criteria are 
responsible for translation of functional requirements includ- 

ing reliability and maintainability into quantitative requirements 
that can be contractually specified with appropriate demonstration. 


Continued review of technical criteria to insure against errors 
and omissions is an essential element of quality assurance. 


The quality of design of an end product may, in part, be 


assessed on the basis of reviewing experience gained with the 
various components that contribute to the design. 


> 


E. Functional test of the end product in a real or simulated 
environment is required where feasible to confirm that per- 
formance requirements, including quality, are met. 


Vi. POLICY 


A. GENERAL 


l. 


Determination that materiel, data, supplies and services 
meet requirements shall be based on objective evidence, 
including the results of direct product examination and 
test, review of procedures, processes, records and 
documentation. The results shall be documented to 
support the planning of corrective action and other 
management activity. 


The degree and type of quality assurance provided during 
the life of a product (from Development through Disposal) 
shall be optimally varied to assure mission responsive- 
nese. 


Defect prevention shall be fostered by: 


a. timely and integrated planning of needed quality 
assurance; 


b. monitoring of appropriate procedures, systems and 
resources; and 


CG. correction of causes of deficiencies. 


There shall be a system, or systems, that will feed back 
quality information to activities responsible for develop- 
ment, procurement and other management functions so 
that action can be initiated to correct/prevent quality 
deficiencies. The Military Departments and DSA shall 
ensure unsatisfactory material quality conditions are 
reported by using activities within their own logistics 
systems and across DoD Component lines as appropriate. 
DSA, in collaboration with the Military Departments shall 
develop a joint regulation covering procedures and format 
for reporting quality data across DoJ) Component lines. 
Information and reporting requirements will be developed 
consistent with the policies prescribed in reference (i). 
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Continuation of VII. A. 


Br 


5. 


l. 


DoD Components shall comply with the DoD-Wide Civilian 
Career Program for Quality and Reliability Assurance 
Personnel (DoD Manual 1430, 10-M-2 (reference (a)) to 
assure maximum employee efficiency and career growth, 


Quality audits of materiel, data, supplies and services 
shall be conducted. 


Adequate and economical metrology and calibration sger =, 
vices shall be established in support of test, measuring 
and diagnostic equipment used throughout the materiel 
life cycle. Measurement accuracies shail be traceable to 
U. S. National Standards maintained by the National 
Bureau of Standards and/or to fundamental physical con- 
stants (see V. F. above) and the referral of time and time 
interval measurements to ''time standards" established by 
the U. S. Naval Observatory under the provisions of 

DoD Directive 5160.51 (reference (d)). 


The institution and continuation of Zero Defects type 
programs shall be voluntary for both contractors and DoD 
Components. Handbook 4155.12H, "A Guide to Zero 
Defects'' (reference (e)) is authorized for use as a guide. 


PROCUREMENT 


Contractors are responsible for (a) controlling product 
quality, (b) offering to the government for acceptance only 
materiel, data, supplies and services that conform to 
contract requirements, and (c) when required, maintaining 
and furnishing substantiating evidence of this conformance. 


DoD Components in accordance with assigned responsi- 
bilities shall: 


a. assure that contracts specify appropriate quality 
requirements; and that contractors comply with 
quality requirements; 


b. comply with DoD 4105.59-H (reference (f)) in assign- 


ing responsibilities for quality assurance administra- 
tion of contracts, 
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1. 


Ba 


1. 


Government procurement quality assurance actions 
performed at the subcontract level are performed solely 
to assist contract administration offices in accomplish- 
ing their responsibilities. Such actions shall not 

relieve the contractor of any of his responsibilities 
under the contract and shall not establish any contractual 
relationship between the government and the sub- 
contractors. 


Contractor quality history data shall be maintained and 
used as applicable by DoD Components. 


The quality assurance policy contained in B. above shall 
be implemented by Armed Services Procurement Regula- 
tion (ASPR) (reference (g)). 


DEVELOPMENT 


Quality assurance shall be provided for early in design 
and development. The development function shall 
include assessinent of the quality requirements in rela- 
tion to cost, schedule and performance parameters. 


Prior to completion of development all specifications, 
standards, inspections, tests and evaluations required to 
insure against degradation of performance during the pro- 
duction process shall be identified or developed. 


Calibration requirements for newly developed materiel 
which necessitates technical advances in the development 
of measuring and test equipment, measuring standards, 
or state-of-the-art techniques, shall be identified and 
programmed early in development. 


IN-HOUSE ACTIVITIES 


Supply and Storage. DoD Components responsible for 
receiving, storing and issuing supplies will develop and 
implement quality assurance, including inspection (for 
both new and returned materiels) for identification, con- 
dition, completeness, preservation, packaging, and 
marking. Materiel in storage will be inspected on a 
planned, cyclic, surveillance basis in accordance with 
the needs of the commodities managed and standards 
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Continuation of VII. D. 4155.1 
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prescribed by the materiel managers. Testing will be 
performed by government laborätories to the optimum 
extent with arrangements made for commercial testing 
only as necessary. 


Maintenance. DoD Components are responsible for pro- 
viding quality assurance monitoring of in-house main- 
tenance functions at all maintenance levels. Conversion, 
modification, overhaul, repair and alteration of materiel 
shall be subjected to quality assurance to insure con- 
formance to requirements, 


Operations. DoD Components are responsible for main- 
taining the quality of performance and readiness of 
equipment in their possession. This responsibility 
includes organizing, training, equipping and providing 
such quality assurance services as are necessary to 
assure materici readiness, 


Manufacturing. DoD Components operating manufac- 
turing activities will assure that management action is 
taken to plan and develop efíective and economical 
quality assurance for material produced. Quality assur- 
ance shall extend throughout design, development, fab- 
rication, processing, assembly, installation, packagir , 
packing and shipping. The quality assurance shall be 
compatible with the engineering and tooling needs of 
production and the related design. 


E. CROSS SERVICING AND FOREIGN SUPPORT 


1. 


2. 


Interservice. DoD Instruction 4105.59 (reference (h)) 
requires that DoD Contract Administration Services 
Components support without charge all DoD organizations 
in quality assurance and related functional areas. 


Foreign and Non-DoD Organizations. Agreements for the 


acquisition of supplies and services entered into by the 
DoD Components with Foreign Governments and Inter- 
national Organizations shall provide for quality assurance 
in consonance with the policies stated herein. Regulations 
and procedures concerning quality assurance support pro- 
vided to, or obtained from, non-DoD organizations, 
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foreign governments, and international organizations, 
are contained in Section 14, Part 6 and Section 20, 
Part 5 and Part 6 of reference (g). 


Vill. EFFECTIVE DATE AND IMPLEMENTATION 


A.. This Directive is effective immediately. DoD Components 
shall take immediate action to implement this Directive and 
forward two copies of each implementing document to the 
Assistant Secretary of Defense (Installations and Logistics) 
within 60 days. 


B. Within one year, the Director, Defense Supply Agency, in 
coordination with the Military Departments, will develop 
a joint procedural document in compliance with the policies 
outlined in VII.A.4., above. All joint procedural documents 
for implementing the policies stated herein will be approved 
by the Assistant Secretary of Defense (Installations and 
Logistics) prior to publication. 


CONS N 
ART a e SE Y. = 


= 
Secretar \of Defense 


Enclosures - 3 
Refs. (j) thru (v) 
2. Definitions 
3. Memo of Understanding 
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REFERENCES Continued 


DoD Instruction 7700. 12, ''Reporting Unsatisfactory Newly 
Procured and Contractor Maintained Materiel, '' November 27, 
1968 (to be cancelled, see Section II, herein) 

DoD Instruction 4155.2, "Government Procurement Quality 
Assurance and Quality Surveillance of Petroleum, ' February 27, 
1967 (hereby cancelled) 

DoD Instruction 4155.9, "DoD Policy for Government Inspection 
of Subcontracted Supplies, * December 31, 1957 (hereby 
cancelled) 

DoD Instruction 4155.10, ''DoD Policies and Procedures for 
Assuring Quality of Production of Complex Supplies and 
Equipment, '' February 10, 1959 (hereby cancelled) 

DoD Directive 4155.11, "Improved Management for Quality and 
Reliability Assurance of Materiel, '' June 17, 1965 (hereby 
cancelled) 

Beo iastruction 4155.12, "Dob Zero Defects Program,” 

April 14, 1969 (hereby cancelled) 

DoD Instruction 4155.13, "Quality Control and Reliability 
Management at Supply and Storage Deport,'' November 27, 

1967 (hereby cancelled) 

DoD Instruction 4155.14, "NATO Standardization Agreement 
(STANAG) 4107 Mutual Acceptance of Government Quality 
Assurance,'' December 11, 1967 (hereby cancelled) 1/ 

DoD Instruction 4155.15, "Quality and Reliability Assurance 
Depot Maintenance Activities,'' March 20, 1968 (hereby 
cancelled) 

DoD Instruction 4155. 16, ''Processing Requests from Foreign 
Governments or International Organizations tor Inspection 
of Direct Procurement," April 8 1968 (hereby cancelled) 

DoD Instruction 4155.17, "NATO Standardization Agreement 
(STANAG) 4108 'NATO Quality Control System Requirements 
for Industry',' August 19, 1968 (hereby cancelled) 1/ 

DoD Directive 4155.18, "Improved Management of Metrology 
and Calibration Programs,'' March 22, 1969 (hereby cancelled) 2/ 

ASD(I&L) Memorandum, "Establishment of DoD Quality and u 
Reliability Assurance Council," 15 August 1964 (cancelled herein) 


1/ STANAG Agreements now implemented in ASPR. (see VII. E.2., of 
basic Directive). 


2/ Memorandum of Understanding remains in effect (see enclosure 3 
attached hereto) 


on 
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DEFINITIONS 


Quality - The composite of materiel attributes including 
performance. 


Quality Assurance - Á planned and systematic pattern of all 
melons necessary to provide adequate confidence that materiel, 
data, supplies and services conformsto established technical 
requirements and achieves satisfactory performance. 


Metrology - The science of measurement for determination of 
Conformance to technical requirements including the development 
of standards and systems for absolute and relative measurements. 


Calibration - Comparison of a standard or measuring equipment 


instrument with a standard of higher accuracy to insure that the 
former is within specified limits throughout its entire range. 
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August 22, 1968 
MEMORANDUM OF UNDERSTANDING 
SUBJECT: Procedure for Determining, Estimating the Cost of and 
Arranging for the Radio and Electronic Calibration Services 


that Department of Defense Activities Obtain from the 
National Bureau of Standards 


1, General 

This memorandum establishes an agreement between the Department 
of Defense (DDR&E-ASD(I&L)) and the Department of Commerce (National 
Bureau of Standards) regarding calibration requirements and services 
pertaining to radio and electronic standards except for Time and 


Time Interval Standards covered by DoD Directive 5160.51. 


Ar pose 


The purpose of this agreement is to establish a uniform procedure 
for: (a) determining DoD requirements for calibration and calibration 
engineering services; (b) a joint DaD/NBS review of these requirements 
to identify those services NBS can provide and to estimate their cost; 
and (c) planning to budget and fund the estimated coat of the services 


that by mutual agreement are to be provided by NBS. 


3. Basis for Agreement 


(a) The services and facilities of the National Bureau of Standards 
in radio and electronic standards are essential for the support of 
DoD operations, 

(b) An effective NBS/DoD relationship requires a continuing exchange 


of information regarding requirements, capabilities, and costs, 
4. Procedures 


(a) A DoD Calibration Coordination Group (DoD/CCG) consisting of 
representatives from the Military Departments and DSA will be the DoD 
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point of contact with NBS on all DoD requirements for calibration and 
calibration engineering services, 

(b) A similar point of contact established by NBS, the Office of 
the Director, Institute for Basic Standards, will make the arrangements 
for, providing che’scuwwtus yertaining to the calibration and cali- 
bration engineering requirements as mutually agreed with the DoD/CCG. 

(c) DoD calibration requirements shall be assembled each year by 
the DoD/CCG to provide the following information as a minimum: 

(1) Quantitative calibration requirements for the 
following two fiscal years; and 

(ii) Calibration engineering requirementz (e. g., require- 
ments involving new equipment and techniques, improved 
accuracies, or expanded ranges) thet have developed 
or are expected to develop during tinis two year period 
plus three additional years, 

(d) NBS will use the information on DoD calibration requirements 
assembled by the DoD/CCG Bor 

(1) Estimate the charge to DoD in terms of a fee or an 
hourly vate for each calibration requirement, these 
fees or hourly rates to be the same gor the DoD as 
for the public; and 

(ii) Identify those calibration engineering requirements 
that can be accomplished by projects initiated with 
funds available to NBS and those that will require 


funding by the DoD, 


ae Time Cycles 
(a) The DoD/CCG will assemble and submit to the Director, NBS, 


on or before 1 September of each year a preliminary schedule of 
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requirements that describe (i) DoD calibration requirements for the 
next two fiscal years (ii) DoD calibration engineering requirements for 
this two year period and the following three fiscal years. 

(b) The Director, IBS, will review the schedule of DoD requirements 
and prepare a cost estimate before 15 November. 

(c) A final schedule of requirements will be prepared by the DoD/CCG 
in cooperation with the Director, NBS by 1 January. The DoD will plan 
to budget and fund the estimated cost of the requirements that have been 
mutually agreed upon between the DoD/CCG and NBS. NBS will plan to pro- 
vide a calibration and supporting services program to meet these re- 
quirements. 

(d) Prior to 1 July, each of the Military Departments will submit 
to NBS a formal work order, The Military Departments will transfer 
advance funds to NBS at the earliest time possible, 

(e) For workloads in addition to those already covered by work orders, 
NBS will charge the Military Departments the same fees or hourly rates 
as are charged to the public, Such additional workloads can be covered 
either by amendment of the original work orders or by new work orders, 

(£) To facilitate transition to the above described procedure, the 
DoD will plan to provide for funded work requested during FY 68 and FY 59 
at a level at least equal to the level of funding for calibration services 


in FY 67, subject to the availability of funds. 


6. Revisions 
This agreement may be reviewed at the request of the DoD or the NBS 


and revised as mutually agreed between the two agencies. 


Concurrence 2 Zu CUBE Date 7 — (sch 


Allen V. Astin, rector National Bureau ol St rds 
Concurrence I ! be; Date Y 


Assistant Secretary of Defense (Installations 
and Logistics) 
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ABSTRACT 


The purpose of this paper is to examine DoD quality assurance policies and 
heir application to Weapon System Acquisition Management. This paper is divided 
INSI sections -- Elements oí Policy, DoD Quality Assurance Policy, Quality 
issurance During System Procurement, Areas Needing Improvement, Project Manage- 
nent, and Conclusions and Recommendations. 


In general, quality assurance policies are consistent and well defined, but the 
wiisedures for implementing these policies need revision in the area of subcontract 
idministration. Particular problems include the lack of standardized procedures for 
‘se by the Military Departments and DCAS, and the inability of contract administra- 
i0n offices at subcontract facilities to perform surveillance because of insufficient 
ersonnel. 


The major deficiency in quality assurance procedures involves the Inspection 
2lause in ASPR which makes acceptance at the source final. The clause is not 
ıiPpropriate for current DoD policy of placing responsibility for quality on its 
contractors because government acceptance relieves the contractor of this 
‘esponsibility. 
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